ABSTRACT
BACKGROUND: The onset of COVID-19 and related policy responses made it difficult to study interactive health informatics solutions in clinical study settings. Instrumented log and event data from interactive systems capture temporal details that can be used to generate insights about care continuity during ongoing pandemics. OBJECTIVE: To investigate user interactions with a digital health wallet (DHW) system for addressing care continuity challenges in chronic disease management in the context of an ongoing pandemic. MATERIALS AND METHODS: We analyzed user interaction log data generated by clinicians, nurses, and patients from the deployment of a DHW in a feasibility study conducted during the COVID-19 pandemic in Kenya. We used the Hamming distance from Information Theory to quantify deviations of usage patterns extracted from the events data from predetermined workflow sequences supported by the platform. RESULTS: Nurses interacted with all the user interface elements relevant to triage. Clinicians interacted with only 43% of elements relevant to consultation, while patients interacted with 67% of the relevant user interface elements. Nurses and clinicians deviated from the predetermined workflow sequences by 42% and 36%, respectively. Most deviations pertained to users going back to previous steps in their usage workflow. CONCLUSIONS: User interaction log analysis is a valuable alternative method for generating and quantifying user experiences in the context of ongoing pandemics. However, researchers should mitigate the potential disruptions of the actual use of the studied technologies as well as use multiple approaches to investigate user experiences of health technology during pandemics.
Subject(s)
COVID-19 , Humans , Pandemics , Continuity of Patient Care , Triage , Feasibility StudiesABSTRACT
BACKGROUND: Kenya is faced with a triple burden of malnutrition which is multi-faceted with health and socio-economic implications. Huge geographical disparities exist, especially, in the arid and semi-arid lands exacerbated by inadequate resource allocation to the nutrition sector and challenges in multi-sectoral coordination and nutrition governance. UNICEF's Maternal and Child Nutrition Programme is a four-year (2018-2022) resilience-building, multi-sectoral program focused on pregnant and lactating women, mothers of children under five years and children under five years. The objective of the mid-term evaluation was to establish the relevance, effectiveness, efficiency, and sustainability of the programme. METHODS: The field evaluation conducted between June and July 2021, adopted a concurrent mixed-methods approach, where qualitative information was gathered through 29 key informant interviews and 18 focus group discussions (6 FGDs per population group; women of reproductive age, adolescent girls and men). Quantitatively, data were obtained through desk review of secondary data from programme reports, budgets, and project outputs where descriptive analysis was undertaken using Excel software. Qualitative information was organized using Nvivo software and analyzed thematically. RESULTS: The findings provide evidence of the relevance of the Maternal and Child Nutrition Programme II to the nutrition situation in Kenya and its alignment with the Government of Kenya and donor priorities. Most planned programme targets were achieved despite operating in a COVID-19 pandemic environment. The use of innovative approaches such as family mid-upper arm circumference, integrated management of acute malnutrition surge model, Malezi bora and Logistic Management Information Management System contributed to the realization of effective outputs and outcomes. Stringent financial management strategies contributed toward programme efficiencies; however, optimal utilization of the resources needs further strengthening. The programme adopted strategies for strengthening local capacity and promoting ownership and long-term sustainability. CONCLUSION: The programme is on track across the four evaluation criteria. However, a few suggestions are recommended to improve relevance, effectiveness, efficiency, and sustainability. A formal transition strategy needs to be developed in consultation with multi-stakeholder groups and implemented in phases. UNICEF Nutrition section should explore a more integrated programming mode of delivery through joint initiatives with other agencies under the Delivery as One UN agenda, along the more gender transformative approaches with more systematic involvement of males and females in gender-based discussions.